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"IMAGE PROCESSING METHOD AND SYSTEM, AND MEDICAL EXAMINATION APPARATUS, 
FOR EXTRACTING A PATH FOLLOWING A THREADLIKE STRUCTURE IN AN IMAGE" 
Description 

FIELD OF THE INVENTION 

The invention relates to an image processing method for extracting the points 
of a path following a threadlike structure represented in an image. In particular, the 
invention relates to an image processing method for extracting the points representing a 

5 catheter guide-wire in an X-ray fluoroscopic medical image or thin vessels in an angiogram. 

The invention also relates to an image processing system and to a medical examination 
apparatus such as an X-ray apparatus having a system and means for image processing. 

The invention is applied to medical imaging systems and to the industry of X-ray 
medical examination apparatus. 

10 BACKGROUND OF THE INVENTION 

A method to determine an object contour, referred to as minimal path, between 
two fixed end points in a 2-D image, is disclosed in the publication "Global Minimum for 
Active Contour Models : A minimal Path Approach" by Laurent D. COHEN and Ron KIMMEL, 
in International Journal of Computer Vision 24(1), 57-78 (1997). This method proposes a 

15 technique of boundary detection of objects for shape modeling in 2-D images. This method 

particularly aims at solving the boundary detection problem by mapping it into a global 
minimum problem and by determining a path of minimal length from the solution of that 
global minimum problem. The method guarantees that a global minimum of energy is found 
by minimizing curves between two end points. This method comprises steps of manually 

20 selecting a start point and an end point in an object contour region of a gradient image ; of 

propagating a front, in the totality of said gradient image, starting at the start point, in such 
a manner that this front propagates at a lower cost in regions of high gradient values until 
the end point is reached : this determines a cost map which is a totally convex surface 
having a single minimum ; and a step of back-propagating from the end point towards the 

25 start point by the steepest gradient descent in said totally convex surface : this provides a 

minimal path between the start and end points. 

This publication includes by reference a front propagation technique disclosed in 
a publication entitled "A fast marching level set method for monotonically advancing fronts" 
by J. A. SETHIAN in Proc. Nat. Acad. Sci., USA, Vol. 93, pp. 1591-1595, February 1996, 

30 Applied Mathematics. According to said reference, a front, formed in a 2-D grid of potential 
values, is propagated using a "Fast Marching Technique" with a determination of the front 
points. The front is a solution of a so-called Eikonal Equation. The Fast Marching Technique 
introduces order in the selection of the grid points and sweeps the front ahead in one pass 
on the 2-D image. The Fast Marching Technique comprises marching the Front outwards by 

35 freezing already visited points denoted Alive, coming from a set of points referred to as 



Narrow Band, and by bringing new ones denoted Far Away into said Narrow Band. The 
Narrow Band grid points are always up-dated as those having minimal potential values in a« 
neighboring structure denoted Min-Heap and the potential of the neighbors are further re- 
adjusted. 

The method known of COHEN's publication constructs the convex surface of the 
cost map using said Fast Marching technique which provides respectively one path of 
minimal cost joining the start point to respectively each point of the front, said front 
propagating until the end point is reached. Then, the minimal path is provided by back- 
propagating from the end point to the start point by the steepest gradient descent in the 
convex surface. The numerous paths constructed by propagating the front forwards and 
joining the start point to the different points of the front for forming the convex surface are 
no more taken into account. Even the path joining the start point to the end point, in the 
operation of forwarding the front, is not the steepest gradient descent in the back- 
propagation operation. 

So, the final path obtained by this known method does comprise points 
extracted by tracking. Neither does it comprise points of a path constructed by front 
propagation. 

Besides, it is interesting to note that the points of a path constructed in the 
operation of marching the front forwards are points which have the smallest possible 
potentials. Starting at the start point, and going forwards from one point to the next point 
must be at the "minimal cost". So, such a path is a path of "minimal Action", i. e. a path on 
which the "Sum" or the "Integral" of potentials calculated over point potentials is the 
smallest though strictly continuously growing as a function of the number of points present 
on said path between the start point and the current point on the front. 

A first problem in extracting a threadlike structure is that said threadlike 
structure may be represented in the original image by a number of thin linear segments 
which are not joined in a strictly continuous manner, having "holes" between them, and 
which are to be found among a great number of other thin unrelated structures, referred to 
as false alarms. A second problem is that said threadlike structure may be very long and 
sinuous so that it may be far from a straight line and may even present U-turns along its 
length, and that it may be formed of a great number of points. 

On the one hand, a path constructed using the front propagation technique 
described in the known publication is not adapted to solve these problems, due to the fact 
that said front propagation is based on an "Action" i. e. a "Sum" of potentials effectuated 
along the constructed path. Because the threadlike structure is very long, this Sum of 
potentials will soon becomes very large on a path following said threadlike structure. When 
said Sum becomes large, the cost becomes high, and, for minimizing costs, the known front 
marching technique may generate a path based on the nearest false alarms in order to 



follow as few points as possible. So, the known front marching technique may generate a 
path which is far from following the sinuous and long threadlike structure. 

On the other hand, the minimal path obtained by the above described minimal 
path method is a smoothed path, which may not possibly provide extracted points strictly 

5 following a long and sinuous threadlike structure. 
SUMMARY OF THE INVENTION 

It is a purpose of the present invention to provide an automatic image 
processing method performed between two predetermined end points for supplying a path 
strictly following a long sinuous threadlike structure. It is a particular purpose of the 

10 invention to provide such a method for processing an original image of such a long and 
sinuous ill-represented threadlike structure and of false alarms and to provide extracted 
points of the threadlike structure as a continuous linear structure of points denoted path, 
appropriate to improve the visualization of said threadlike structure. j 

It is also a purpose of the invention to provide a medical examination apparatus 

15 using an image processing system to carry out this method and to process medical images. 
* Such an image processing method is claimed in Claim 1. And such a medical 

examination apparatus is claimed in Claim ****. 

Advantages of the method are that it is automatic, robust and reliable ; it 
accurately and securely follows the long sinuous threadlike structure without looking for a 

20 shorter path and without providing holes and false alarms ; it is less calculation-time 

consuming than the known front marching technique, it may be applied to construct 3-D 
images from 2-D data and it is implemented with simple means. An advantage of the 
apparatus is that the visualization of thin long structures in a medical image, such as a 
guide-wire in an angiography image for instance, or brain vessels, is improved. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is described hereafter in detail in reference to diagrammatic 
figured, wherein : 

FIG.l is a functional block diagram illustrating the main steps of the path- 
tracking method ; 

30 FIG.2A to 2C illustrate the front propagation according to the Filiation Front 

Marching technique in a grid of points ; 

FIG.3 is a curve of the weight to be affected to each potential in function of 
number of points along the track determined by the Filiation Front Marching technique from 
the Ancestor or Start Point to the last found Child or current point ; 
35 FIG.4A and 4B illustrate the calculation of the turning angle at a point of the 

track for determining the curvature of the path ; 

FIG.5 illustrate an X-ray apparatus having a system for carrying out the method. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The invention first relates to an image processing method based on a path- - 
tracking operation performed between two fixed end points for supplying a path strictly 
following a long sinuous threadlike structure represented on a background in a digital image. 
In particular, the invention relates to an image processing method for path-tracking the 
points representing a catheter guide-wire in an X-ray fluoroscopy medical image. In an other 
particular application, the invention may relate to the path-tracking of thin brain vessels 
which have a threadlike shape. The invention also relates to a system implementing the 
method and to an X-ray medical examination apparatus having such a system and means for 
image processing and image visualization. 

In the first particular case of guide-wire path-tracking, the medical image may 
be an X-ray static arteriogram image representing at least a blood vessel with a guide-wire. 
In cardiology, such an image may be used to present medical data related to the blood 
vessel for further medical procedures. The medical procedures using catheter deeply rely on 
the correct visibility of the guide-wire which is a metallic wire introduced in the vessel for 
guiding the catheter. An image processing operation of path-tracking this guide-wire in an 
arteriogram image, that is the detection and location of the points belonging to said guide- 
wire, can serve several highly interesting purposes. For example, a binary extraction mask 
may be constructed from the path-tracking operation thus increasing visibility, in order to 
improve the practitioner ability to determine medical data. After a complete extraction of the 
guide-wire points, the guide-wire tip can be located and an area of interest may be defined 
around this tip. This enables further local processing for better visibility enhancement of a 
tool called stent introduced in the vessel for its enlargement. In the second particular case, 
the medical image may be an angiogram of the brain where the vessels have been made as 
visible as possible by injection of a contrast fluid to the patient. The brain angiogram 
contains very thin vessels which may be very difficult to visualize. The method according to 
the invention permits the practitioner of better visualizing said vessels. Alternately, in both 
cases, the data may be used to construct 3-D images. 

The present path-tracking operation uses a Front Marching technique referred 
to as Filiation Front Marching technique denoted FFM which is not based on a "Sum" or an 
"Integral of potentials" to go from one point to another, as known from the state of the art, 
but which is instead based on terms of "Weighted Sums of Potentials". It is to be noted that 
the "Weighted Sums of Potentials" correspond to calculated terms of "Cumulated Costs" 
which may not be strictly continuously growing. This property of strictly continuous growing 
which is existing in the terms of "Sums" or "Integrals" of the Prior Art technique is no more 
existing in the terms of "Cumulated Costs" of the present path-tracking operation. So, 
according to the present Filiation Front Marching technique, it results that the property of 
relying on the construction of a minimal path is no more existing. Actually, the path tracking 
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operation based on said Filiation Front Marching technique FFM aims at providing a "Best 
Path" which is not bound to be the "Minimal Path". The "Best Path" is defined as the path 
which is validated by using the hereafter described Filiation Front Marching FFM technique. 

Now, the FFM technique first comprises a definition of a function of Cumulated 

5 Costs associated to each processed point, which is based on the Potentials of the processed 
points and which is especially adapted to path-tracking long sinuous threadlike structures. 
Such a function formed of terms of Cumulated Costs is no more strictly growing, thus the 
cost map which may be constructed from these terms of Cumulated Costs is no more exactly 
convex, and the required path is no more allowed to be obtained by the simple steepest 

10 descend from the End point to the Start point. Using this function of Cumulated Costs, the 

found Best Path may not be minimal. Moreover, this Filiation Front Marching technique FFM 
is not based on the known Eikonal Equation used in the Prior Art, but instead is based on a 
specific "Distance" for defining a distance relationship establishing a direct filiation between 
consecutive points which belong to a path and which are denoted "Father and Child". 

15 The path-tracking operation using the FFM technique comprises an initializing 

phase of setting end points for the required Best Path, denoted Start and End Points, which 
are defined in an image of Potentials. Using said relation of direct filiation, in a first 
processing phase of the technique, the front is marched forwards, starting from the Start 
Point which is referred to as the "Ancestor", until it reaches the End Point which is referred 

20 to as the "Last Child". Then, in a second processing phase of the technique, the required 

Best Path is found by tracking backwards from the Last Child to the Ancestor. 

Referring to FIG.l, which is a functional block diagram illustrating the image 
processing method for path-tracking a threadlike structure based on the Filiation Front 
Marching FFM technique, said method comprises : 

25 an operation 1 of image data acquisition from an Original Image denoted 01, 

for instance a medical image such as a cardiogram including a guide-wire or any angiogram 
including thin vessels to be extracted ; said image data include digital intensity levels 
referred to as pixel values, and pixel coordinates in the Original Image ; 

an operation 2 of construction of a contrast image IP in which each pixel of the 

30 Original Image is associated to a new calculated intensity level which is taken as a Potential ; 

such an operation may be carried out by any technique known of those skilled in the art for 
enhancing troughs in the Original Image : for instance, in the cited medical Original Image 
01, the objects of interest, either guide-wire or opacified vessels, are darker than the 
background ; so, the Original Image 01 is first inverted, then the ridgeness is evaluated by a 

35 filtering operation : by this filtering operation, for example, the maximal curvature is 

calculated at each current point as a differential invariant by passing a Gaussian filter then a 
differential operator, thus providing enhanced ridges in the places of the objects of interest ; 
tine filtered image is further again inverted to provide an image referred to as " Image of 



Potentials" which is the contrast image IP, where the objects of interest are again darker 
than the background and form thin troughs substantially contrasting on the background ; 

an initializing phase 3 of setting end points including a Start point A denoted 
Ancestor and an End point B denoted Last Child between which a path following a given 
object of interest, that is the threadlike object, is to be determined in the contrast image IP ; 

a first processing phase 4 of path-tracking using the front propagation 
technique referred to as Filiation Front Marching FFM technique, to march a Front forwards 
from the Start Point A to the End Point B ; in said first processing phase 4, marching the 
Front forwards according to the FFM technique provides First Tracks for the path ; 

a second processing phase 5 of path-tracking also using the Filiation Front 
Marching technique FFM, starting at said End Point B considered as the last born Child and 
propagating the front backwards thus following one First Track backwards ; in order to come 
down said First Track, it is necessary and sufficient to follow the filiation from Child to Father 
and Grandfather until the Ancestor which is the Start point A is reached ; it is different from 
going down the steepest gradient descent of the known convex cost map ; the required Best 
Path is obtained in this second processing phase 5 by said backtracking operation. 

Using the Filiation Font Marching technique FFM, the first processing phase 4 of 
marching the Front forwards has the advantage of not being time consuming because the 
Front is not wide and does not try many solutions. The second processing phase 5 has the 
advantage to provide the required Best Path having no holes, including no false alarms and 
strictly following the threadlike structure. The description of this Filiation Front Marching 
technique FFM includes first a description of the front construction technique, then a detailed 
description of the function of terms of Cumulated Costs. 

Referring to FIG.2A to FIG.2C, the Front according to the FFM technique is 
constructed in an iterative manner. FIG.2A to FTG.2C each represents a grid of points in the 
Image of Potentials IP constructed in the operation 2 from the Original Image acquired in 
the operation 1. This Image of Potentials contains the two End Points set in the initializing 
phase 3, including the Start Point A and the End Point B. An advantageous specific Distance 
law to be used in this FFM technique is based on the known City Block Distance. Said 
Distance law permits of propagating, on a path constructed by FFM technique, only along 
lines or columns of the grid of points, with one grid point interval between two successive 
points referred to as Father and Child. Also, an advantageous Criterion of costs, which will be 
further described, provides a function of Cumulated Costs related to a point of the grid called 
Child, said Criterion taking into account a function of the Cumulated Costs related to the 
Father of this Child and of the Potential at this Child. 

Referring to FIG.2A, at a certain stage of the front propagation denoted instant 
to, the Image of Potentials IP comprises already visited points which are referred to as 
Frozen Points, located in a zone denoted FZ, and which are represented by dots. These 
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Frozen Points are not allowed to change state, that is to have the name of their location FZ 
of their associated function of Cumulated Costs modified. It is the reason why they are 
referred to as Frozen Points. The already propagated front is a set of points including the 
Start Point A which is the Ancestor and Frozen points forming paths going to the last Frozen 
Points found before the instant to. This Frozen zone has an outwards boundary referred to 
as LOFZ. The interior of the Frozen zone FZ are points labeled Frozen Points and having only 
neighbors labeled Frozen Points. 

Besides the Frozen Points, the image of Potentials IP comprises points which 
are situated in a zone denoted NB, adjacent to the Frozen zone, referred to as Narrow Band 
whose points are represented by crosses. This Narrow Band surrounds the Frozen zone 
external boundary and has itself a further external boundary denoted LONB. So, the external 
boundary LOFZ of the Frozen zone is a set of points labeled Frozen Points having at least one 
neighbor labeled Narrow Band Point. 

The Image of Potentials IP moreover comprises points referred to as Far Points 
represented by small squares, located in a zone denoted FAR, which includes all points 
external to the Narrow Band and the Frozen zone. So, the external boundary LONB of the 
Narrow Band is a set of points labeled Narrow Band Points having at least one neighbor 
labeled FAR Point. 

According to this FFM technique, an operation of examining a point of the r 
Narrow Band, considered as a Child, is performed. The Father of this point must be a point 
of the Frozen zone which is a neighbor of the Child and which is such that the function of 
Cumulated Costs related to said Child associated to said Father is minimal with respect of 
other functions of Cumulated Costs which may be calculated for said Child associated to 
other possible Fathers. For instance, in the example of FIG.2A, a part of the grid of points is 
examined. This grid part comprises at this given instant to : 

Points Pi, ?2, P 3 , P 6 which are in the Frozen zone FZ ; 

Points P 9 , P 4 , P 5 which are in the Narrow Band NB ; 

Points P 7/ P 8 which are in the FAR zone FAR. 
These points of the grid are examined and, in the example of FIG. 2k, current point P 5 is 
found to present two properties : It is located in the Narrow Band and its function of 
Cumulated Costs, calculated according to the Criterion which will be further described, is 
minimal with respect to those of the other points of the Narrow Band. The current point P 5 is 
then selected as the Narrow Band point having the minimal function of Cumulated Costs at 
this instant to. According to this FFM technique, said current point P 5 having such properties 
is decreed a possible Father. 

Referring to FIG.2B, at the next instant tl, in the Image of Potential IP, the 
state of this current point P 5 is modified by marching the limit LOFZ of the Frozen zone 
towards the Narrow Band zone so as to include point P5 into the Frozen zone. Said limit is 



now referred to as L1FZ. Further on 7 the point P 5 is a Frozen point having the function of 
Cumulated Costs previously determined and is referred to as a Father. Now, according to this 
FFM technique, it is looked for the only Child of this Father. 

Referring to FIG.2C, at the instant t2 following tl, in the image of Potentials IP, 
the neighbors of the Father Point P 5 are examined. According to the Distance law of the FFM 
technique, only adjacent points on lines and columns may be neighbors and, unlike the 
method cited as prior art, the diagonal points are not relevant and thus not considered. So, 
according to the Distance law of the FFM technique, in the case illustrated by FIG.2C as an 
example, there are four existing neighbors which are P 8 , P 4 , P 6 , P 2 . All neighbors must be 
examined and possibly updated. Their state may be modified, L e. some of them may 
become Children : 

Neighbors P 6 , P 2 are in FZ. They remain Frozen Points. 

Neighbor P 8 is in FAR. At this instant t2, the limit of the NB zone is 
marched towards the FAR zone so as to include this neighbor P 8 in the Narrow Band zone 
according to a new limit L2NB of the Narrow Band, thus filing the hole created in the Narrow 
Band at the previous instant tl by marching the Frozen Zone limit forwards to reach the 
location L1FZ. The Narrow Band preferably does not remain with a hole. At this instant t2, 
point P 8 in the Narrow Band becomes a Child whose Father has to be determined. 

Still referring to FIG.2C, at the instant t3, the Father and the Cumulated Cost of 
this new Child P 8 are determined. The Father of the Child P 8 must be the neighbor which is 
already located in FZ and which has the smallest related function of Cumulated Costs. Only 
point P 5 answers these conditions because it has been selected as having the smallest 
function of Cumulated Costs according to the result of the calculation of the Criterion as 
explained in relation to FIG.2B. So this Frozen Point P 5 may be decreed to be the Father of 
Child P 8 . Now, a new function of Cumulated Costs is to be calculated for this Child P 8 from 
said further described Criterion, which takes into account the function of Cumulated Cost of 
the Father P5 and the Potential at the Child. 

Neighbor P 4 is in NB. It remains in NB. This point P 4 of the Narrow 
Band has had until instant t3 a Father and a related function of Cumulated Costs which have 
been determined at a given previous instant. Let this previous function of Cumulated Costs 
be denoted CCi and this previous Father be for example Pi of the Frozen zone FZ. For 
searching the Father of this Child P 4 , the points located in the Far zone are not relevant 
points, said points having infinite costs. Point P 2 is in a diagonal position with respect to Child 
P 4 , so ? 2 is not relevant. Thus, only Pi and P 5 may be possible Fathers. 

At the following instant t4, it is investigated whether the point P 5 may be a 
better Father for its neighbor P 4 than the previous Father ? x of said Child point P 4 of the 
Narrow Band. To that end, a new function of Cumulated Costs denoted CC 2 is calculated for 
this Child P 4 , taking into account that this point P 5 may be a Father of P 4 . For that purpose, 



this new CC 2 takes into account the function of Cumulated Costs related to said possible 
Father P s and the Potential at said Child P 4 . Then CC1 and CC 2 are compared. 

When CC 2 > CQ, it means that it is not interesting to make the required path 
pass through possible Father P 5 . So point P 5 is not decreed the Father of P 4 . 

When CC 2 < CC U it is interesting to make the required path pass through Father 
P 5/ so said point P 5 may be decreed the new Father of the neighbor P 4 instead of Pi and CC2 
is the new function of Cumulated Cost related to the Child P4 associated to the Father P5. 

The Criterion giving the function of Cumulated Costs CQ< related to a given 
current point P k is a function of the sum of the minimum among the Cumulated Costs of the 
neighbors of said current point P k and the Potential at said point. According to the present 
Filiation Front Marching technique FFM, since the cost related to the current point is 
calculated from the Minimum "Min" of a number of Cumulated Costs constituted by the 
Cumulated Costs of its neighbors located at one grid interval on the same line or column, the 
Argument "Arg" of said minimum "Min" supplies the location of the point referred to as 
"Father" of the current point P k which is last gone out of the Narrow Band. 

The Father of the current point P k is the last point gone out of the Narrow Band 
in order to become a Frozen Point. The next FAR Point becomes a Narrow Band Point. This 
former FAR point had an infinite Cost. It must be attributed a new function of Cumulated 
Cost. The point last gone out of the Narrow Band gives its function of Cumulated Cost to its 
neighbor FAR Point and becomes its possible Father. 

The function of Cumulated Cost CC k may preferably be determined by the 
hereafter-described Criterion providing a robust and reliable value. This Criterion is described 
in two examples of Techniques referred to as CC k First Calculation Technique and CC K 
Second Calculation Technique which is a refined version of the First Calculation Technique. 

The First Calculation Technique to compute CC* takes into account that the 
track between the Ancestor and the current point must have in average the lowest Potential 
value. So this First Technique involves a Potential Mean Value instead of the Potential Sum 
or Integral known of the State of the Art. According to the Filiation Front Marching 
Technique, the length of the path between the Ancestor and the current point is calculated 
by adding 1 each time a Father fathoms a Child. When the Father is located at the above- 
described City Block Distance denoted Distance U from the Ancestor, the Child P k is located 
at a Distance L k +1 which may be written U+i- So, the Distances between the Ancestor and 
the current points are updated, and the CC k values are further calculated as follows as a 
Potential Mean Value (1) : 

cc^go, (1) 

where Qj are the Potentials at the current points located between the Ancestor and point P k . 
The previous relation (1) may be written : 



cc _ (CC k , 1 )(L k , 1 ) + Q k 
U 



(2) 



Thus, each time a Child is fathomed, the Distance is updated by adding 1, and the new 
function of Cumulated Cost is calculated from the previous function of Cumulated Cost, the 
previous Potential and the previous Distance. Unlike the law known of the State of the Art 

5 where the paths are associated to the smallest ^Q k , which penalizes the long threadlike 

structures, according to the invention said paths are associated to the smallest Q k which 
favors said long threadlike structures. 

Referring to FIG. 3, which shows a curve of CQ versus the potential Q k where k 
is the number of points on the path starting from the Ancestor, it is to be noted that the 
10 function CQ is weighted by a constant weight having the value 1/L k . Unlike the State of the 

Art, where the Q k which is used is weighted by a weight 1, according to the invention 

the function CC k is weighted by the term 1/U which is length dependent and brings an 
advantageous correction to the function evaluation. The Distance L K is the above-described 
City Block Distance. However, it is to be noted that in relation (2) the potential Q k has only a 

15 small influence on the CC K value which is a cause of lack of sensitivity to local Potential 

variations. An advantage is that the sensitivity of the path tracking technique is substantially 
independent of the path length. 

According to the invention, in this First Calculation Technique, the function CC k 
is evaluated using first order recursive filters which supply the required Weighted Sum (2). 

20 A second Calculation Technique is described hereafter in order to solve said 

problem of lack of sensitivity. Now, in said Second Calculation Technique, the function CC k is 
calculated using an average effectuated on predetermined limited temporal spans defined 
from the current point, which permits, as the path is progressively constructed, to 
progressively "forget" the data related to points processed prior to said temporal spans. So, 

25 this Technique permits of taking into account Local Events in a given past. 

For calculating the function CQ, the track is searched first only locally in the 
best possible direction, taking into account the Local Events. To that end, only the functions 
of Cumulated Cost related to the points found in a given past are taken into account for 
calculating the function CCk, while the functions of Cumulated Cost related to points which 

30 where found in a longer past are "forgotten" i. e. they are not taken into account. This is 

obtained using one parameter a which is a weighing factor of minimization of the influence 
of points situated farer than at a given distance of the current point. This weighing factor is 
applied to the previously described function of Cumulated Costs, where CQ-i is the function 
of Cumulated Cost related to the Father and Q K is the Potential at the current point : 

35 CC K = aCC^ + (1 - a)Q K (3) 



II 



The a parameter is a constant and fixes the temporal span, and the number of Fathers 
which is taken into account. The span may be approximated by the relation : 

1/(1- a ) where 0 < a < 1. (4) 
If a = 0,9, the number of Fathers which is taken into account to calculate CC k is about 10. 
5 If a = 0,5, the number of Fathers which is taken into account to calculate CC k is about 20. 

Now, it is not sufficient to take into account Local Events, because the Filiation 
Front Marching technique may be deceived and may lose the good track. So Global Events 
must also be taken into account. To that end, the Filiation Front Marching technique takes 
into account the curvature along the First Track in order to avoid zigzags. It is known of 

10 those skilled in the art to calculate the Turning Angle at a current point, and to derive the 

curvature from the Turning Angle value. The Turning Angle is defined as the angle between 
the tangent to the track at the current point and a reference axis. Then a term based on the 
curvature value is taken into account for function CC k calculation in order to penalize track 
trajectories having too many points associated to important curvature values. 

15 The Filiation Front Marching technique according to the invention provides a 

front propagation which is made discrete by using the City Block Distance law which permits 
of horizontal or vertical increments of value 1, but it does not provide curvature means of 
calculation. So according to the invention, a first order recursive filter is used to calculate a 
reliable curvature along the First Track. The filiation law, based on the City Block Distance, 

20 gives the distances DXk, DY k along the lines and the columns, i. e. the x axis and y axis, 

between Father P K -i and Child P K as : 

DX* g [-1, 0, 1] (5A) 
DYk e [-1, 0, 1] (5B) 
Diagonal movements are not allowed. So a Turning Angle is obtained by a calculation based 

25 on the value of the ratio DX / DY. A first Turning Angle is calculated related to the short past 

and a second Turning Angle is calculated related to the long past. As an example, the past 
including 10 Fathers is a short past (SP), the past including 20 Fathers is a long past (LP). 



So, the distances are provided by the relations : 

DXsp(k) = P DXk + (1- J3 ) DX sp( k-i) (6A) 

30 DYspck) = J3 DY K + (1- P ) DX^k-d (6B) 

Now, taking into account the long past (LP) to calculate the distances : 

DXlpoo = y DX K + (1- y ) DXcpck-d (7A) 

DXa>(K) = / DYk + (1- y ) DY^k-x) (7B) 



where 0< f3 < y < 1, and/ being constant parameters. Approximately, ft = 0.1 for 
35 10 Fathers and y = 0.05 for 20 Fathers. From the above relations of DX K and DY K , 6A, 6B, 



7A, 7B, the Turning Angles are calculated at each point either taking into account the short 
past SP or the long past LP. These Turning Angles are denoted respectively #sp(k> *#lp(k). ' 

<9sp(k> = atg ( DY S p(K)/DXsP(K)) e [0, ;r] (8A) 

0 lp(k) = atg ( DYlp^DXlpco) € [0, n ] (8B) 

5 from which the curvature K K is calculated at the current point by a difference of the two 

Turning Angles related to short past and long past so as : 

Kk = | 9 LP(K) " 9 SP(K) | (9) 

as illustrated by FIGs 4A, 4B showing the possible relative dispositions of 6 SP(K) , 9 
resulting in different possible values of the difference K K . 

10 From the curvature K k/ and a new weight W which takes into account the 

potential and the curvature and may be for instance W = 0,5, the cost Q< is provided by the 
following recursive relation : 

CC K = a CQ-i + (1-a ) [Q k + W.KJ (10) 
According to the above relation, CC k is a function of local measures providing a good 

15 sensitivity and of global measures providing substantially smooth paths* The calculation of 

CC K may be carried out by recursive filters for determining the geometry, i. e. locations, and 
the kinetic, i. e. speed and acceleration, of the points belonging to a given path. 

Referring to FIG.5, an X-ray medical examination apparatus 150 comprises 
means for acquiring digital image data of a medical image, and a digital processing system 

20 120 for processing these data according to the processing method described above. The X- 

ray apparatus comprises an X-ray source 101, a table 102 for receiving a patient to be 
examined, an optical system 103, 104 for providing image data to the processing system 120 
which has at least one output 106 to provide image data to display and/or storage means 
107. The display and storage means may respectively be the screen 140 and the memory of 

25 a workstation 130. Said storing means may be alternately external storing means. This 

image processing system 120 may be a suitably programmed computer of the workstation 
130, or a special purpose processor having circuit means such as LUTs, Memories, Filters, 
Logic Operators, that are arranged to perform the functions of the method steps according 
to the invention. The workstation 130 may also comprise a keyboard 131 and a mouse 132. 
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1". An image processing method for extracting the points of a path following a 

threadlike structure in an image formed of a grid of Potential points, comprising : 

a first processing step of performing a first path-tracking operation using a front 
5 marching technique denoted Filiation Front Marching Technique for supplying at least one 

First Track formed of succeeding points denoted Fathers and corresponding Children of the 
threadlike structure by marching a Front of points forwards starting at a predetermined Start 
point until a predetermined End point of said grid is reached, 

and a second processing step of performing a second path-tracking operation 
10 using said Filiation Front Marching Technique for supplying a Best Path from one First Track 

by back propagating the Front starting at the End Point and going through already 
determined Children and corresponding Fathers until the Start Point is reached. 

2. A method as claimed in Claim 1, wherein, for performing the first path-tracking 
operation, the Front Marching Technique propagates the Front forwards when the following 

15 conditions for selecting a second point denoted Child to succeed a first point denoted Father 

of the grid to form a First Track are satisfied, said conditions comprising: 

a law of location for the Father which must already pertain to the Front, and a 
criterion of cost for said Father referred to as Cumulated Cost which must be minimal 
compared to other points of the Front, 

20 a law of location for the Child, which must be on the same row or column of the 

grid (City Block Distance) as the Father with one grid point interval, and a criterion of cost 
referred to as Cumulated Cost for said Child including a term of the minimum among the 
Cumulated Costs of the succeeding points already selected from the Start Point to said 
Father and a term of the Potential at said Child, 

25 a law of filiation according to which said determined Child becomes a possible- 

further Father of the Front for further forwarding the Front. 

3. A method as claimed in Claim 2, wherein : 

the function of Cumulated Costs (CQ) to associate to a current point referred to 
as Child is calculated as follows as a Potential Mean Value (1) : 

30 CC^-L^O, (1) 

where Q j are the Potentials at the current points located between the Start Point and said 
current point (P k ), and U is the length of the path between the Start Point and the Father of 
said Child calculated using a City Block Distance Law. 

4. A method as claimed in Claim 3, wherein : 

35 the length of the path between the Start Point and the current point referred to 

as Child is calculated using the City Block Distance Law by adding 1 each time a Father 
fathoms a Child, so as when the Father is located at a determined Distance (U) from the 



Start Point, the Child (P k ) is located at an updated Distance which is said Distance of the 
Father plus one unity (U+l, U+i) and so as the function of Cumulated Costs (CCO to 
associate to said Child may be written according to relation (2): 

cc k = (cc»Xi„)+Q. w 

5 which is a function of Cumulated Cost for the Child calculated from the function of 

Cumulated Cost of the Father (CC K ), the Potential at the Child (P K ) and the Distance from the 
Start Point to the Father (L K .0. 

5. A method as claimed in Claim 4, wherein : 

the function (CC k ) of Cumulated Cost to attribute to a current point referred to 
10 as Child is calculated using an average effectuated on predetermined limited temporal spans 
which permits of taking into account Local Events. 

6. A method as claimed in Claim 5, wherein : 

calculating the function (CQ) of Cumulated Cost using an average effectuated 
on predetermined limited temporal spans is obtained using one parameter a which is a 
15 weighing factor progressively minimizing the influence of points situated farer than at a 

given distance of the current point so as said function (CC k ) of Cumulated Cost is given by 
the following relation (3) : 

CC K =oCC K _ 1+ (l-a)Q K (3) 
where the weighing factor a is a constant and fixes the temporal span, and the number of 
20 Fathers which is taken into account, where CC K -i is the function of Cumulated Cost related to 

the Father and Q K is the Potential at the current point. 

7. A method as claimed in Claim 6, wherein : 

the span may be approximated by the relation : 

1/(1- a ) where 0 < a < 1. (4) 
25 8. A method as claimed in one of the Claims 5 to 7, wherein : 

besides taking into account Local Events, the Filiation Front Marching technique 
also takes into account Global Events and to that end, takes into account the curvature value 
at the current point along the First Track, said curvature (K K ) being derived from a Turning 
Angle value which is defined as the angle between the tangent to the track at the current 
30 point and a reference axis so as a term based on the curvature value is taken into account to 

calculate the function (CC k ) of Cumulated Cost in order to penalize track trajectories having 
too many points associated to important curvature values. 
9. A method as claimed in Claim 8, wherein : 

from the curvature (K k ), and from a weighing factor (W) which takes into 
35 account the potential at the current point and said curvature, the function (CC k ) of 

Cumulated Costs is provided by the following recursive relation : 
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CC K = a CQ.! + (l-a ) [Qk + W.KJ (10) 
where CQ is a function of local measures and of global measures. 

10. A method as claimed in any of the preceding Claims, comprising : 

an operation (1) of image data acquisition from an Original Image (OI) 
5 representing a threadlike structure on a background, said image data including digital 

intensity levels, and pixel coordinates in the Original Image ; 

an operation (2) of construction of an Image of Potentials (IP) in which each 
pixel of the Original Image (OI) is associated to a Potential forming a grid of points ; 
and, performed in said Image of Potentials : 
10 an initializing phase (3) of setting end points including a Start point (A) and an 

End point (B) between which a path following the threadlike structure is to be determined ; 

a first processing phase (4) of front propagation, using the Filiation Front 
Marching (FFM) technique, to march the front from the start point A to the end point B ; 

a second processing phase (5) also using the Filiation Front Marching technique 
15 (FFM), starting at the End Point (B) towards the Start Point (A), propagating backwards from 

each Child to the corresponding Father until the Start Point A is reached. 

11. A method as claimed in Claim 10, wherein : 

the operation (2) of construction of a contrast image IP for associating each 
pixel of the Original Image to a new calculated intensity level which is taken as a Potential, 

20 comprising, in an Original Image where the objects of interest, among which the threadlike 

structure, are darker than the background : an operation of inversion of the intensity levels ; 
a filtering operation of evaluation of the ridgeness ; and an operation of further inversion to 
provide an image of Potentials where the objects of interest are again darker than the 
background and form thin troughs substantially contrasting on the background. 

25 12. An image processing method for performing a path-tracking operation to extract 

points of a threadlike structure in an image formed of a grid of Potential points, using a front 
marching technique denoted Filiation Front Marching Technique for supplying at least one 
Track formed of succeeding points denoted first points (Fathers) and corresponding second 
points (Children) of the threadlike structure by marching a Front of points forwards 

30 comprising steps of : 

setting predetermined Start and End Points in said grid, 
propagating the Front forwards between the Start and End Points when the 
following conditions for selecting a second point (Child) to succeed a first point (Father) of 
the grid to form the Track are satisfied, said conditions comprising: 

35 a law of location for the first point (Father) which must already pertain to the 

Front, and a criterion of cost for said first point (Father) referred to as Cumulated Cost which 
must be minimal compared to the Cumulated Costs of other points of the Front, 



a law of location for the second point (Child), which must be on the same row 
or column of the grid (City Block Distance) as the first point (Father) with one grid point - 
interval, and a criterion of cost referred to as Cumulated Cost for said second point (Child) 
which must be minimal compared to cumulated Costs obtained with other possible first 
5 points (Fathers), 

a law of filiation according to which said determined second point (Child) 
becomes a possible further first point (Father) of the Front for further forwarding the Front, 
said Cumulated Costs including a term of the minimum among the Cumulated Costs of the 
succeeding points already selected from the Start Point to a so-called first point and a term 
10 of the Potential at a so-called second point. 

13. A system comprising a suitably programmed computer or a special purpose 
processor having circuit means, which are arranged to process image data according to the 
method as claimed in any of the preceding Claims. 

14. An apparatus having means to acquire medical image data, having a system 
15 as claimed in claim 13 having access to said medical digital image data, and having means to 

display the processed images. 

15. A computer program product comprising a set of instructions 
for carrying out a method as claimed in one of Claims 1 to 12. 



Abstract 



An image processing method for extracting the points of a path following a 
threadlike structure in an image (IP) formed of a grid of Potential points, comprises : a first 
5 processing step (4) of performing a first path-tracking operation using a front marching 

technique denoted Filiation Front Marching Technique (FFM) for supplying at least one First 
Track of the threadlike structure, formed of succeeding points denoted Fathers and Children, 
by marching a Front of points forwards from a fixed Start point (A) to a fixed End point (B), 
and a second processing step (5) of performing a second path-tracking operation using said 
10 Filiation Front Marching Technique for supplying a Best Path from one First Track by back 

propagating the Front starting at the End Point and going through already determined 
Children and Fathers until the Start Point is reached. An X-ray apparatus is proposed, having 
means for carrying out said method for improving the visualization of catheter guide-wire. 
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Figure 1 

Application : Medical Imaging ; X-ray Apparatus. 
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